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ABSTRACT 

The ability to authenticate images captured by a security 
camera, and localise any tampered areas, will increase the 
value of these images as evidence in a court of law. This 
paper outlines Che challenges in security camera video 
authentication, and discusses the reasons why 
fingerprinting, a robust type of digital signature, provides 
a solution preferable to semi-fragilo watermarking. A 
fingerprint based upon block DC differences is described, 
and the tamper detection performance is assessed both 
theoretically and experimentally, the latter using an 
automated method of 'tampering' images. 



1. INTRODUCTION 

The need for image authentication arises from the ease 
with which digital images may bo edited and altered. 
Appropriate authentication techniques should be capable 
of verifying that the image content is unchanged, and of 
localising any image portions that have been altered. 

A difficulty, however* is that certain changes to the 
images are allowable, and should not be classified as 
malioions tampering. For example, lossy compression 
causes Image modifications, but not to an extent that alter? 
a person's interpretation of the imago. These modifications 
must not be mistaken for tampering. 

The issues surrounding image authentication are 
discussed in this paper within the context of security 
cameras. This application aims to increase die value of 
video evidence in a court of law by demonstrating that 
tampering of the video has not taken place. 

Section 2 sets the scenario for security camera video 
authentication, This is followed in Section 3 by a summary 
of the alternative authentication methods of semi-fragile 
watermarking and digital signatures. Section 4 describes a 
solution appropriate for security cameras, and' the 
performance of this system is presented in Section 5. 

2. AUTHENTICATION REQUIREMENTS 

Figure 1 illustrates the layout of a typical surveillance 
system. This consists of the following components: 



Digital recordor 



Tamper 
detection 




Figure 1 - A surveillance system including authentication 



1. Camera - the video output is usually in an analogue 
format, such as PAL or NTSC 

2. Digital recorder - this takes die video inputs from 
multiple cameras and applies lossy compression 

3. Computer network - ibis provides storage, retrieval, 
and authentication means for the compressed video 

2«2» Allowable processing 

Figure 1 shows the allowable image alterations; between 
capture and authentication the video travels through an 
analogue link, and is then compressed. The distortions to 
the video that result must not be mistaken for tampering, 

A variety of compression methods are in use in 
surveillance systems, including both spatio-temporal (e.g, 
MPEG), and still-Image techniques (e.g. JPEG, ADV601 
[11). Where still-image compression is applied, 
.compression in the temporal direction is achieved by 
retaining, for example, only one image every 5 seconds. 

2,3. Tampering 

The envisaged type of tampering is pixel replacement For 
oxample, this could be the removal of a person by 
replacement with 'background' content, perhaps copied 
from an earlier/later image in which the person is absent 

A guideline for the minimum detectable size of 
tampered region is the minimum size at which a human 
face is recognisable. The information in [2] points to a size 
of approximately 33 pixels wide and 50 pixels high for 
PAL/NTSC video content. 

3. ALTERNATIVE APPROACHES 

Tamper detection proceeds by comparing authentication 
data derived from the suspect image with the 
corresponding data derived from the original image. This 
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can be decomposed into two sub-problems: 

1, How to generate appropriate authentication data 

2, How to transport the authentication data of the 
original image to the point in the system where 
authenticity is tested 

At tiie camera it is not known whether the recorder win 
discard images during compression. The authentication 
data must therefore be generated and transported such that 
each image may be authenticated independently, without 
reference to images at any other point in time. 

The ability to distinguish between allowable and 
malicious alterations is usually referred to by the term 
vemUfragiU. There are two alternative authentication 
solutions depending upon where this fragility is located: 
1, Semi-fragile watermarks: the transport of the original 
image's authentication date is such that it can be 
correctly retrieved after allowable alterations, but not 
after tampering 
% Semi-fragile digital signatures: the generation of the 
authentication data is such that the data id invariant to 
allowable alterations, but not to tempering 
These two alternative approaches will now be discussed in 
more, detail. 

&1. Semd-fragtte watermarking 

Semi-fragile watermarking [3,4] usually generates a fixed 
pattern of bits for the authentication data, and then embeds 
these using a semi-fragile technique, Authenticity checking 
consists of extracting the watermark bits and comparing 
them against the pattern that was embedded The locality 
of tampered image regions is indicated by errors in the 
extracted authentication bits. 

The use of a fixed pattern of embedded bits facilitates 
the creation of apparently authentic tampered images. For 
example, pixels can be replaced by content copied from 
the same location in a different, but authentic, image [5]. 
Extraction of the watermark bits will still be auccessfcl, 
and so the altered image will be judged authentic* 

Security can be increased by generating the 
authentication bits such that they are dependent upon the 
image content. This can help prevent the copy attack 
example given above. If die content dependent watermark 
bits also possess fragility to tampering, then such a scheme 
has properties of both semi-fragile watermarking and 
semi-fragile signatures. If, for example, the authentication 
data and watermark are fragile to different types of image 
alterations, then this approach can help indicate what type 
of tampering has taken place. 

Semi-fragile watermarking can only protect the image 
features (e,g* pixels or frequency coefficients) that are 
used for embedding the authentication data. Protecting the 
most perceptually important image features therefore 
requires data to be embedded into these features. This may 
present difficulties in ensuring watermark invisibility. 
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- Any image material in which watermark bits cannot be 
both invisibly embedded and reliably detected (e.g. flat 
content), will result In bit errors even -without tampering 
[fi]. There is no way to distinguish these bit errors due to 
zero watermark capacity from those due to tampering. The 
replacement of original image regions by flat content can 
therefore create an apparently authentic tampered imago. 

In [7] an attempt iB made to overcome this problem via 
'backup embedding 1 . Bach watermark bit is embedded 
twice, using two spatially separate embedding locations* 
However, in the presented method there is no guarantee 
that the backup location does not also have zero 
watermark capacity. Embedding each authentication bit 
multiple times must also have negative, implications for 
either the tamper localisation ability (due to fewer 
authentication bits for a given embedding capacity), or for 
invisibility and robustness to allowable operations (due to 
an increased number of embedded bits). 

Semi-fragile digital signatures and fingerprints 

A digital signature is a set of authentication bits that 
summarise the image content- A semi-fragile signature is 
generated in such a way that a tampered image gives a 
changed set of summary bits, but an image processed only 
by allowable manipulations does not This non bit- 
sensitive type of signature will be referred to as a 
fingerprint in order to provide a clear distinction from 
cryptographic digital signatures, and highlight the 
relevance to other applications [8]. 

The image features from which the fingerprint bits are 
calculated may be chosen to give the most appropriate 
trade-off between robustness to allowable processing, 
fragility to tampering, and computational: cost There are 
many suggestions in the literature including; DC values 
[8], moments C°], edges [9], histograms [10], compression 
invariants [11], and projections onto noise patterns [12]. 

Authenticity is verified by comparing the fingerprint 
generated from the suspect image, with the original 
fingerprint calculated in the camera. Typically, a direct 
relationship exists between individual fingerprint bits and 
an image location.. For example, the image may be Bplit 
into blocks and a bit derived for each block. The locality 
of tampered image regions is therefore indicated by which 
particular fingerprint bits are in error. 

Note that there is a trade-off between the number of 
fingerprint bits and the localisation ability. For example, a 
smaller block size allows better localisation of tampered 
areas, but there are more blocks per image, and thus more 
fingerprint bits. 

Having generated a fingerprint of the original image in 
the camera, there remains the problem of transporting this 
fingerprint data, .such that it is available at authenticity 
verification. One possibility is to embed die fingerprint 
bits into the image as a watermark. This, and alternatives 




PHNL021036EPP 

3 

for handling the fingerprint as 'meta-data\ ate discussed 
in the following two sub-sections. 

3.2.1 Transport by watermark 

Watermarking provides a neat solution to the transport 
problem! by invisibly embedding the fingerprint into the 
image, this data is automatically carried with the image, 
dearly the watermark must be robust to (at least) all 
allowable image processing, If the watermark is also semi- 
fragile, this can aid identification of the type of tampering 
that has occurred, as explained in Section 3.L The content 
dependent nature of the fingerprint bite also helps prevent 
watermarked content copied from one image to another 
from appearing authentic. 

A fingerprint protects against alteration of the image 
features used to calculate the fingerprint bits. These 
feature* may be different from those used to embed the 
fingerprint as a watermark. This gives increased flexibility 
to embed bits in the most appropriate manner for 
invisibility and robustness requirements, and helps avoid 
the zero watermark capacity problems from which semi- 
fragile watermarking authentication schemes suffer, 

A drawback of transporting fingerprint data using a 
watermark is that this may limit the tamper localisation 
ability. A sufficiently robust watermark will typically have 
a fairly limited payload size* which may place an 
unacceptable constraint upon the fingerprint size, and 
hence upon the localisation ability. 

3.2.2 'Transport by metadata 

Transporting fingerprint data separate from the video is 
not possible due to the analogue cable between the camera 
and recorder. This requires that the authentication data 
generated in the camera must be embedded into the video. . 
signal itself for transmission to the recorder. 

An alternative to watermarking, is to embed the 
fingerprint data directly into the pixel values, in a manner 
similar to teletext data in television signals. Security 
cameras currently transport camera parameters, control 
information, and audio using such data channels. The data 
carrying capacity of these data channels can be far greater 
than a watermark, depending upon how many, video lines 
are utilised. If only video lines in the over-scan area 
(vertical blanking interval) are employed, then invisibility 
of the embedded data is maintained* 

It is important that fingerprint data is encrypted before 
it is embedded in this manner. Without encryption, 
substitution of the original fingerprint data with a 
fingerprint corresponding to a tampered image would 
make the forgery appear authentic. Missing or damaged 
authentication data must always be interpreted as 
t fttnpftri ng. 
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4. A SOLUTION FOR SECURITY CAMERA VIDEO 
AUTHENTICATION 

An authentication system for security cameras is currently 
in development. The chosen approach embeds fingerprints 
into the over-scan area of the video signal. The details of 
the fingerprint formation and authentication are presented 
in the following sections, 

4.1* Fingerprint calculation 

Fingerprints should be calculated based upon the low 
frequency content of the image. This is necessary to 
provide resilience to the analogue link, which severely 
limits the video signal bandwidth, and lossy compression, 
which typically discards the higher frequency components. 

In applications where the allowable processing 
Operations are well characterised, this knowledge may be 
utilised in fingerprint calculation. For example, properties 
that are invariant to JPEG quantisation are used to form 
fingerprints in [11]. However, due to the wide variety of 
compression methods used in surveillance systems (see 
Section 2.2) such an approach is not possible. 

As mentioned in Section 3, the camera must calculate 
and embed authentication data in real-time for each and 
every output image. This places severe constraints upon 
the computational load if the impact upon die camera cost 
is to be minimised* 

A low frequency and low complexity fingerprint can be 
formed by utilising only the PC component The image is 
divided into blocks, and differences between blocks* DC 
values (mean pixel luminance) are used to form the 
fingerprint Using DC differences provides invariance to 
changes in the overall image DC. component, e.g. due to 
brightness alterations. Taking differences between the DC 
values of adjacent blocks captures how the image content ; 
of each block relates to its neighbours. More specifically, 
a fingerprint bit b f is derived for the P block as follows; 

*l=i<DC t -DCj) (1) 

fycsi if a i >Q f b t e*Q otherwise 

where; indexes the eight blocks that nelgbour block *, 

The appropriate block size is related to the stee of 
image feature upon which tamper detection is desired. 
Smaller blocks increase the likelihood of alterations being 
detected, but at the cost of an increased number of 
fingerprint bits to calculate and transport 

4 A Authenticity verification 

The most straight-forward approach to checking 
authenticity is a simple bit by bit comparison of the 
original and suspect authentication bits. This alone. 
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however, te unlikely to be satisfactory, as soma bit errors 
due to allowable processing are almost inevitable [4]. 

Methods to solve this problem are often baaed upon 
the observation that these bit error* due to allowable 
processing are likely to bo lightly distributed over the 
whole image, whereas bit errors due to tampering are 
Uteiy to be concentrated hi a confined area. Allowable 
operations can therefore be distinguished ftom tampering 
via a post-processing operation upon the bit errors, such as 
error relaxation [9], or mathematical morphology [13]. 

Note that authenticity verification can afford more 
complex computation than fingerprint calculation, as it 
Will occur relatively infrequently, need not be real-time, 
and haft a more powerful computation platform available. 

Rather than applying an "afterthought' postprocessing 
step to provide resilience to allowable processing* it is 
preferable to build this robustness more closely into the 
authenticity decision. This can be achieved by using K soft- 
decision' information during comparison of the suspect 
image's fingerprint with the original fingerprint bits, This 
prevents tampering from being indicated in cases where ^ 
is close to zero, and therefore a fingerprint bit error is 
likely to occur due to allowable processing. 

The authenticity decision for an individual block can 
be expressed as a choice between hypothesis H 0 (the 
block's image content is authentic), and hypothesis Hi (the 
block's image content has been tampered with). Given the 
value a of the block (computed according to Equation 1), 
and the fingerprint bit of the original image b D7 f S , the 
hypothesis with the greatest probability is chosen: 
If Er[J3T 0 | ^»j)>RtH 1 | b^sl choose H 0 

but, from Bayea theorem: 

MB* I V rf l B p M w 
and similarly fur Hi* so the decision rule becomes: 

It is difficult to assign values to the prior probabilities 
of each hypothesis (this would be equivalent to stating 
what proportion of images are tampered), so the Neyman- 
Peargon [14] decision rule is more appropriate. This 
approach maximises the probability of tampering being 
detected for a fixed 'false atom 9 probability of allowable 
processing being mistaken for tampering. In practice this 
simply results in the prion being replaced by a threshold 
A, which is set to achieve the desired false alarm rate; 
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If hypothesis Hj is true, then wo have ud knowledge of 
the replacement content and can only assume that the 
result of Equation 1 is distributed as for image content in 
general, i,e. P^W s ftW' 



Figure 2 - Conditional FDFs of S under each hypothesis 

The probability density function (PDF) p s (y) has been 
estimated from a set of linages* and turns out to be well 
approximated by a Japlacian distribution. Arguments 
similar to chose in [ 1 5] can be used to explain this shape, 
but ate omitted here* 

If hypothesis H 0 id true, then the outcome of Equation 
1 for the original image, S 0H09 is of known sign, given by 
the value of b cris > The distribution of S or u is therefore the 
one-sided version of p s (a) (Le. exponential). Allowable 
processing operations then cause an error E> resulting in 
the observed value S^&^+JS, The distribution of JS should 
be estimated for the harshest allowable processing to 
which images will be subject* e.g. the lowest JPEG quality 
factor, Typically a gaussian distribution provides a 
reasonable approximation to the PDF of E> Finally, 
assuming independence of Sow and E, the following 
convolution gives the PDF required for the hypothesis test: 

Figure 2 shows a plot of this PDF for the case of E 
corresponding to JPEG compression of quality factor 50, 
and Jprf^i. Note the -deviation from the exponential 
shape, which Is due to & This gives nan zero probabilities 
of S being negative, arid thereby models fingerprint bit 
errors duo to allowable processing. 

From Figure 2, whatever the value of the threshold A, 
the FDFs only cross at a single point The hypothesis test 
therefore reduces to a simple threshold test on blocks' 
values of 5. The threshold value s T for b crit pl satisfies: 

W|»o W 58 ^|», C*r> 
and, by symmetry, the threshold for 1^=0 is -Jy." 

It is also clear from Figure 2 that a feature S possessing 
a less peaked PDF is desirable. This would reduce the 
smearing over the bit threshold due to & giving fewer 
fingerprint bit errors due to allowable processing. 

Note that the above derivations assume that values of S 
are independent and identically distributed for different 
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blocks, la practice this is not quits true, and some 
correlation exists between values of S for adjacent blocks. 
Nevertheless, as will be seen in the results of Section 5, 
the approach appears very nsefuL 

An advantage of the above hypothesis test framework 
is (bat it allows the possibility of errors in the original 
fingerprint bits to be taken into account This is achieved 
by making the value of b oriB a random variable distributed 
according to the bit error rate of the transport channel 

A further advantage of the presented approach is that 
improvements in tine localisation of tampered areas are 
possible by adjusting the operating point (i.e* the threshold 
A) . Normally X is set to achieve the desired low falso alarm 
rate. However, once one or more blocks are identified as 
tampered, the image as a whole is known to be unauthentic, 
and each individual block may be considered equally 
likely to bo tampered or authentic* This points towards re- 
evaluating the authenticity decision for all blocks using 
equal prior probabilities (i.e. /M). This approach can be 
taken even further by taking the spatial distribution of 
tampered blocks into account For example, a block with 
several tampered neighbouring blocks is also likely to be 
tampered. These beliefs can bo expressed by modifying 
the prior probabilities, or equivalency* the vahio of JL 
Experiments have shown that these adjustments of the 
operating point and rc-cvaluation of authenticity decisions 
can help extract die size and shape of the tampered region 
with greater accuracy. 

5. RESULTS 

The performance of an authentication system can be 
measured by its probability of detecting tampering, and its 
false alarm probability when only allowable image 
processing has been applied. Few publications provide this 
information, usually giving only one example image on 
which the authentication method is demonstrated. The 
detection probability in particular la difficult to assess as it 
requires the tampering of a large number of images, and 
manually replacing sections of an image in a convincing 
way is very time consuming, 

To overcome this, the detection rate has been estimated 
by an automatic process that blends image content from a 
Becond unrelated image into the image under test Many 
trials ate performed, using different test images, different 
tampered locations, and different replacement image 
content The whole test is also repeated for different sizes 
of tampered area In order to gain a full picture of the 
performance of the authentication method, 

Figure 3 shows an example imago and a version of it 
that has been tampered under the above procedure. A 
block of nxn pixels had been replaced, of which the central 
fxf pixel block is entirely new content, and the 
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Figure 3 - Example 'tampered' Image 



surrounding pixels are a blend of the original end 
replacement content formed using a window function* 

The measured false alarm and detection probabilities 
using this 'simulated tampering' are given in Figures 4 and 
5 as a function of the decision threshold sp The presented 
results are for a fingerprint of 1 bit per 32x32 block of 
pixels, and allowable processing of JPEG quality factor 
50. Figure 4 shows that the false alarm probability exhibits 
the expected transition around the fingerprint bit threshold 
of S=*0~ The sharpness of the transition is due to the high 
robustness of the property 5 to JPEG compression, and 
consequently small chance of allowable processing 
causing fingerprint bit errors. Figure 5 shows the detection 
probability for two different sizes of tampered area. It is 
clear that for good detection rates, the fingerprint block 
size ia required to be smaller than the xninimwu size of 
tampered area that it is wished to detect 

The performance of the authentication system can also 
be estimated theoretically using the probability 
distributions derived in the previous section. The detection 
find false alarm probabilities for an individual block are: . . 

£ P«uw«tt* 
Assuming the individual block decisions to be 
independent, the false alarm probability for the entire 
image can be estimated as; 

ft(FalficAlann)=l-^-PrCR^)7 
where iVis the number of fingerprint blocks in the imago. 
This ia plotted in Figure 4 and can be seen to show good 
correspondence with the experimental results. This 
justifies using the theoretical approach to calculate the 
valuoof ^ to be used in practice, where a false alarm rate 
ISoo low to be simulated m a reasonable time is required. 

The detection probability for the whole image can 
similarly be estimated by: 

Protection) = l-$-PtCD)J* 
However, setting the value of M, the number of tampered 
blocks, is problematic as it is dependent upon tba size and 
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shape of the tampered region with respect to the 
fingerprint blocks. In Figure S the detection probabilities 
are estimated by setting: 

where the tampered area is a block of nxn pixels, and the 
fingerprint Is formed using blocks of bxb pixels- This can 
be seen to give a reasonable match to the experimental 
results, and is thus a useful estimation of the detection rate 
when setting the decision threshold. 

6. CONCLUSIONS 

A fingerprinting solution for security camera video 
authentication has been presented. Fingerprints basod 
upon Mods DC differences have been shown to give a 
good trade between compression robustness, sensitivity to 
tampering, and computational coat. 

A hypothesis test approach to authenticity verification 
has been introduced. This offers advantages of: tolerance 
to fingerprint bit errors caused by allowable processing; 
the ability to cope with bit errors in the received original 
fingerprint; and improved localisation of tampering by 
adjustment of the prior probabilities* 
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Figure 5 - Probability of tamper detection 
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Improved Localisation of Image Tampering 
Introduction 

The ease with which images and video may be edited and altered when in digital form stimulates the 
need for means to be able to authenticate content as original and unchanged* Where it is judged that an 
image had been altered, it is also desirable to have an indication of which imago areas have been 
changed. 

The authentication problem is complicated by the fact that some image alterations are acceptable, such 
as those caused by lossy compression. These chants may cause slight degradation of the image 
quality, but do not affect the interpretation or intended use of the image. The result is that classical 
authentication techniques from cryptography are not appropriate, as typically these methods would 
interpret a change of just one bit of an image aa tampering. 

There are two approaches for robust (i,o. not bit sensitive) imago authentication that appear in the 
literatures semi-fragile watermarking, and robust digital signatures (also known as 'fingerprints'). Both 
of these approaches basically boil down to making a comparison between a set of bits calculated from 
the suspect image and the corresponding set of bits calculated from the original image content The 
descriptions and invention that follow are applicable irrespective of whether these authentication bits 
constitute a watermark or a fingerprint* 

Background 

Authentication bite are derived from the suspect image, by computing some property, & of the image 
pixel values, and then thresholding S to givo either a '0 r or *1' bit The computed property depends 
upon the watermarking or fingerprinting scheme being used. Typically, an image will bo divided into 
blocks (of, for example, 16x16 pixels)* and an authentication bit is generated for each block. This 
allows localisation of imago alterations, as an error in a particular bit can be related to an alteration of a 
particular image region. 

For each of the original authentication bits, a decision must be made whether the suspect image is 
likely to generate a matching authentication bit or not This equates to judging whether the 
corresponding image block is authentic or altered. If a block is judged to be tampered, and the image 
content has indeed been altered, this ia called a detection. K , on the other hand, a block is judged 
tampered when in fact its content has only undergone allowable operations (e*g. compression), the 
decision is incorrect and is called & false alum. 

A crude system makes the authentication decision by comparing the bits derived from the suspect 
image against the original authentication bits. A more sophisticated approach is to use 'soft decision' 
information. In this case the unthresholded values of the properly S calculated from the suspect image 
are used to judge authenticity. Values of S that are on die wrong side of the threshold to generate a bit 
matching the original authentication bit may still be judged authentic if they are close to the threshold. 
This gives more robustness to allowable image operations, reducing the probability of false alarms 
occurring. 

Setting exactly which range of values of S will be classified as authentic, and which as tampered, fixes 
the false alarm and detection probabilities. According to where the decision boundary is placed, 
different trade-offs between the detection and false alarm probabilities can be achieved. This is often 
displayed in a Receiver Operating Characteristic (ROC), A typical shape of ROC curve is displayed in 
Figure 1. 
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Figure i - Example ROC curve 

la Image authentication, it is expected that only a small minority of images wUl actually be tampered. It 
is therefore important to have a low probability of false alarm, otherwise large numbers of authentic 
images will he declared tampered. The operating point on the ROC curve will therefore usually be 
chosen to give an acceptably small false alarm rate. 

Selecting an operating point that gives a low false alarm probability also reduces the detection 
probability, as illustrated in figure 1. This means that many tampered blocks wUl not be detected. 
Assuming that the tampered region spans multiple authentication blocks, then the probability of all of 
the altered blocks not being detected is much smaller* so the feet that the image is inauthentic win still 
be apparent- 

Although a low Also alarm operating point can still achieve a good probability of detecting whether 
images have been altered, it has more serious implications for the localisation of image alterations. The 
low detection probability for individual blocks leads to a patchy detection of which image regions have 
been changed This is illustrated in the Figures that follow: Figure % shows the original image, and 
Figure 3 the altered version; Figure 4 shows which authentication blocks are judged as tampered. 

It can be seen in Figure 4 that numerous image blocks are judged as tampered, so it is cleat that the 
image is inauthentic. However f comparison between Figures 2, 3, and 4 illustrates the patchy detection 
of the tampered image area; the full size and shape of the altered image region is not readily: apparent, 



The object of the invention 
regions.' 4 



presented in the next section is to improve the localisation of altered image 
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Figure 3 - Tampered image 
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Figure 4 - Tamper detection results 



rue Invention 

The idea is to utilise 'context* information In the authentication decision for each Mock, In other words, 
the number and location of blocks that arc declared tampered affects the decisions about which other 
blocks may bo tampered. For example, blocks neighbouring a tampered block are under greater 
suspicion than blocks fttrther away* This context information can be incorporated Into the 
authentication decisions by adjustments to the operating point on the ROC curve. 

The authentication check for an image therefore proceeds as follows: 

1 . An authentication decision is made for each block independently using a low false alarm operating 
point 

2. If no blocks are declared tampered, then the image is taken as authentic 

3. If one or more tampered blocks axe found then it is known that the image as a whole is inanthentic. 
This means that blocks neighbouring those that arc tampered are also likely to be tampered, and all 
other image blocks can bo assumed equally likely to be authentic or tampered. Knowing this, new 
operating points are selected for each block's authentication decision. 

4. The authentication decisions for all blocks not (yet) declared tampered are re-evaluated using the 
new decision boundaries 

5. If farther blocks are declared tampered, the procedure of adjusting tho decision boundaries and re- 
evaluating blocks 4 authenticity is repeated. This continues until no further tampered blocks are 
identified 

Alterations to tho decision boundary can be used to move tho operating point to a position with a larger 
detection probability. This can find further tampered blocks, and thus help determine the Ml size and 
shape of the tampered image region. Applying tins procedure to the example shown in Figure 4, 
provides the result shown in Figure 5. The ranch fuller coverage and localisation of the tampered 
region is evident. 
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Figure 5 - Tamper detection results using the invention 

Note that the concept of adjusting the operating point on the ROC curve, and re-evaluating decisions in 
the light of neighbourmg decisions, is of value net only in image or video or audio XaH^hS 
is equally applicable to other fields where many interrelated decisions have to belaten!^^ 

Example Implementation 

£2£ te^^^S eXamPl ° implementati011 WU1 * *» Ftat — Aground 

One framework for making the authentication decision for each block is to use a hvnothosia test. Own 
SjSSSff ^fyS^lvtercd for the suspect image block, the h^otSSaf h?Mo^ 
tampered (.Hi) is selected* this has a greater probability man the hypothesis 0«t the block™ autS 

Select Hjift Pr()Hi/S = s)>Pr(Ho/S = s) 
h^fflSJ^ terma0fthfipr ° babllity dBD ^ f fttnctbn8 of *» ■* *» 1^ probabilities of each 

p(p/Hb) R-Oa) 

The difficulty with this decision process is setting the values of the prior probabilities, Prflft) (the 
probability that any given image is tampered), and Pr(Ha) (the probability mat any given imago is 
autontic). These probabilities are unlikely to be Saown, so instead their ratio can be represented by a 

9elec tH; tf :4^)>A 




018 09.10.2002 13 



PHNU)2103 



09OCT2002 



12 



Tbs decision process can now be seen as comparing the likelihood of the value j being generated by 
altered image content, against the likelihood of it being generated by authentic cement The decision, 
boundary is determined by the value of X. Different values of X result in different false alatm and 
detection probabilities, allowing a ROC curve to be plotted. Choosing a value ft>r X to give a specific 
felse alarm probability therefore selects the operating point on the ROC curve. This approach known 
as the Neyman-Pearsan decision criterion, and can be shown to maximise die detection probability for 
a chosen probability of felee alarm. 

Using this decision framework* the invention can be applied as follows: 

1. An operating point A 0 is chosen that gives an acceptably low false alarm rate. The authenticity of 
all imago blocks is assessed using this decision threshold 

2. If no blocks are declared tampered, then the image Is taken as authentic 

3. If one or more tampered blocks are found, then for all other blocks j, a new operating point ^ is 
determined, This adjustment of the decision threshold will take into account the number of 
tampered blocks found, and their proximity to the block f. Many algorithms for adjusting the 
decision threshold are possible. One example is: . 

where Al = l (representing equal prior probabilities), M>1 (giving a higher detection 
probabili^),andaisj^vettby: - 



where n is the number of the S blocks neighbouring block i that are marked as tampered, r is the 
distance (in units of blocks) of block 2 from the closest tampered block, and d is some maximum 
distance that sets how widely around a tampered block that suspicion is raised 
4. The authentication decisions arc reevaluated using the new decision boundaries Xj 
$ , If further blocks are declared tampered, the procedure of adjusting the decision boundaries and re- 
evaluating blocks' authenticity is repeated. This continues until no further tampered blocks are 
Identified 





This example makes it clear that adjusting the operating point is equivalent to adjusting the prior 
probability of a block being tampered. This is turn is justified by the block's context, Le. its location 
With respect to other tampered areas. 
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CLAIMS 



1. A method of verifying the authenticity of media content, comprising the steps 
of: 

- extracting a sequence of authentication bits from said media content by comparing 
a property of the media content in successive sections of the media content with a 

5 threshold, 

- receiving a sequence of authentication bits, said received sequence being extracted 
from an original version of the media content by comparing said property of the 
media content with a first threshold, and 

- declaring the media content authentic if the received sequence of authentication 
10 bits matches the extracted sequence of authentication bits, 

characterized in that the step of extracting the authentication bits from the media ' 
content comprises setting the threshold in dependence upon the received 
authentication bits such that the probability that an extracted authentication bit 1 
matches the corresponding received authentication bit is increased compared with 
15 using the first thresholds 

2. A method of verifying the authenticity of media content, comprising the steps > 
of: 

- extracting a sequence of authentication bits from said media content by comparing 
20 a property of the media content in successive sections of the media content with a 

threshold, 

- receiving a sequence of authentication bits representing an original version of the 
media content, and 

- declaring the media content authentic if the received sequence of authentication 
25 bite matches the extracted sequence of authentication bits, 

characterized in that the step of extracting the authentication bite from the media 
content comprises controlling the threshold in dependence upon the received 
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authentication bits such that the probability that an extracted authentication bit 
matches the corresponding received authentication bit is relatively high. 

3. A method as claimed in claim 1, further comprising a second phase in which 
5 the step of extracting is repeated using the first threshold. 



of extracting is repeated using a threshold being controlled in dependence upon the 
distance between the section for which the authentication bit is extracted and sections 
10 for which it has been found that the authentication bits do not match with the received 
authentication bits. 

5. A method and arrangement for adjusting the operating point (or, equivalent!;?, 
the decision boundary, or prior probabilities) according to context information as 

15 given, for example, by a neighboring decision 

6. Application of the idea within a hypothesis test decision framework (as given 
in the example implementation) 

20 7. Application of the idea in multimedia (image/video/audio) authentication 
decisions 

8. Adjustment of operating point (or, equivalent^, the decision boundary, or 
prior probabilities) in multimedia authentication decisions according to context 
25 information as given, for example, by proximity to areas already determined as 
tampered 



4. 



A method as claimed in claim 1, comprising further phases in which the step 
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ABSTRACT 



The ability to authenticate images captured by a security camera, and localise 
any tampered areas, will increase the value of these images as evidence in a court of 
5 law. This paper outlines the challenges in security camera video authentication, and 
discusses the reasons why fingerprinting, a robust type of digital signature, provides a 
solution preferable to semi-fragile watermarking. 

Typically, the suspect image is divided into blocks. For each block, an 
authentication bit is generated by computing some property of the image content and 

10 than toesholding said property to give a '0' or T. The authentication bits of the 
suspect image are compared with those of the original image. If there is a mismatch, 
and the content has indeed been tampered, this is called a detection. A mismatch due 
to allowable operations (e.g, compression) is called a false alarm. A so-called ROC 
curce (Receiver Operating Characteristic) gives the relation between detection 

15 probability and false alarm probability. The threshold used to determine the 
authentication bits represents an operation point on the ROC curve. 

In accordance with the invention, an operation point corresponding to a low 
false alarm probability is initially chosen. Mismatching authentication bits may then 
bo considered to have indeed been caused by tampering. This justifies the conclusion 

20 that the image has been tampered. However, a low false alarm rate also corresponds to 
low detection probability: many tampered blocks will not be detected. This leads to a 
patchy detection of the tampered image area. In order to more precisely identity the 
tampered image area, the authentication decisions are repeated for neighboring 
blocks, using a different operation point This continues until no further tampered 

25 blocks are found* • * 

Hg.: none 
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